Nonlinear Quantum Neuro-Psycho-Dynamics 
66 ■ with Topological Phase Transitions 

o. 

CN . Vladimir G. Ivancevic* Tijana T. Ivancevic^ 



CN ', Abstract 

We have proposed a novel model of general quantum, stochastic and chaotic psychody- 
^^ ' namics. The model is based on the previously developed Life-Space Foam (LSF) framework 

•^r . to motivational and cognitive dynamics. The present model extends the LSF-approach 

by incorporating chaotic and topological non-equilibrium phase transitions. Such extended 
LSF-model is applied for rigorous description of multi-agent joint action. The present model 
is related to Haken-Kelso-Bunz model of self-organization in the human motor system (in- 
cluding: multi-stability, phase transitions and hysteresis effects, presenting a contrary view 
to the purely feedback driven neural systems), as well as the entropy-approach to adaptation 
in human goal-directed motor control. 
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1 Introduction 

Classical physics has provided a strong founda- 
tion for understanding brain function through 
measuring brain activity, modelling the func- 
tional connectivity of networks of neurons with 
algebraic matrices, and modelling the dynamics 
of neurons and neural populations with sets of 
coupled differential equations (Freeman, 1975, 
2000). Various tools from classical physics en- 
abled recognition and documentation of aspects 
of the physical states of the brain; the struc- 
tures and dynamics of neurons, the operations 
of membranes and organelles that generate and 
channel electric currents; and the molecular and 
ionic carriers that implement the neural ma- 
chineries of electrogenesis and learning. They 
support description of brain functions at sev- 
eral levels of complexity through measuring neu- 
ral activity in the brains of animal and human 
subjects engaged in behavioral exchanges with 
their environments. One of the key properties 
of brain dynamics are the coordinated oscil- 
lations of populations of neurons that change 
rapidly in concert with changes in the environ- 
ment (Freeman and Vitiello, 2006; Ivancevic, 
2006a, 2007b). Also, most experimental neuro- 
biologists and neural theorists have focused on 
sensorimotor functions and their adaptations 
through various forms of learning and memory. 
Reliance has been placed on measurements of 
the rates and intervals of trains of action poten- 
tials of small numbers of neurons that are tuned 
to perceptual invariances and modelling neu- 
ral interactions with discrete networks of simu- 
lated neurons. These and related studies have 
given a vivid picture of the cortex as a mosaic 
of modules, each of which performs a sensory 
or motor function; they have not given a pic- 
ture of comparable clarity of the integration of 



modules. 

According to Freeman and Vitiello (2006), 
many-body quantum field theory appears to be 
the only existing theoretical tool capable to ex- 
plain the dynamic origin of long-range correla- 
tions, their rapid and efficient formation and 
dissolution, their interim stability in ground 
states, the multiplicity of coexisting and pos- 
sibly noninterfering ground states, their degree 
of ordering, and their rich textures relating to 
sensory and motor facets of behaviors. It is his- 
torical fact that many-body quantum field the- 
ory has been devised and constructed in past 
decades exactly to understand features like or- 
dered pattern formation and phase transitions 
in condensed matter physics that could not be 
understood in classical physics, similar to those 
in the brain. 

The domain of validity of the 'quantum' is 
not restricted to the microscopic world (Umeza- 
va, 1993). There are macroscopic features of 
classically behaving systems, which cannot be 
explained without recourse to the quantum dy- 
namics. This field theoretic model leads to the 
view of the phase transition as a condensation 
that is comparable to the formation of fog and 
rain drops from water vapor, and that might 
serve to model both the gamma and beta phase 
transitions. According to such a model, the 
production of activity with long-range correla- 
tion in the brain takes place through the mech- 
anism of spontaneous breakdown of symmetry 
(SBS), which has for decades been shown to de- 
scribe long-range correlation in condensed mat- 
ter physics. The adoption of such a field theo- 
retic approach enables modelling of the whole 
cerebral hemisphere and its hierarchy of com- 
ponents down to the atomic level as a fully in- 
tegrated macroscopic quantum system, namely 
as a macroscopic system which is a quantum 



system not in the trivial sense that it is made, 
Uke all existing matter, by quantum compo- 
nents such as atoms and molecules, but in the 
sense that some of its macroscopic properties 
can best be described with recourse to quan- 
tum dynamics (see Freeman and Vitiello, 2006 
and references therein). 

It is well-known that non-equilibrium phase 
transitions (Haken, 1983, 1993, 1996) are phe- 
nomena which bring about qualitative physical 
changes at the macroscopic level in presence 
of the same microscopic forces acting among 
the constituents of a system. Phase transi- 
tions can also be associated with autonomous 
robot competence levels, as informal specifica- 
tions of desired classes of behaviors for robots 
over all environments they will encounter, as 
described by Brooks' subsumption architecture 
approach (Brooks, 1986, 1989, 1990). The dis- 
tributed network of augmented finite-state ma- 
chines can exist in different phases or modal- 
ities of their state-space variables, which de- 
termine the systems intrinsic behavior. The 
phase transition represented by this approach 
is triggered by either internal (a set-point) or 
external (a command) control stimuli, such as 
a command to transition from a sleep mode to 
awake mode, or walking to running. 

On the other hand, it is well-known that 
humans possess more degrees of freedom than 
are needed to perform any defined motor task, 
but are required to co-ordinate them in order to 
reliably accomplish high-level goals, while faced 
with intense motor variability. In an attempt 
to explain how this takes place, Todorov and 
Jordan (2002) formulated an alternative the- 
ory of human motor coordination based on the 
concept of stochastic optimal feedback control. 
They were able to conciliate the requirement 
of goal achievement (e.g., grasping an object) 



with that of motor variability (biomechanical 
degrees of freedom). Moreover, their theory 
accommodates the idea that the human mo- 
tor control mechanism uses internal 'functional 
synergies' to regulate task-irrelevant (redun- 
dant) movement. 

Until recently, research concerning sensory 
processing and research concerning motor con- 
trol have followed parallel but independent paths. 
The partitioning of the two lines of research in 
practice partly derived from and partly fostered 
a bipartite view of sensorimotor processing in 
the brain - that a sensory/perceptual system 
creates a general purpose representation of the 
world which serves as the input to the motor 
systems (and other cognitive systems) that gen- 
erate action/behavior as an output. Recent re- 
sults from research on vision in natural tasks 
have seriously challenged this view, suggest- 
ing that the visual system does not generate 
a general-purpose representation of the world, 
but rather extracts information relevant to the 
task at hand (Droll et al, 2005; Land and Hay- 
hoe, 2001). At the same time, researchers in 
motor control have developed an increasing un- 
derstanding of how sensory limitations and sen- 
sory uncertainty can shape the motor strategies 
that humans employ to perform tasks. More- 
over, many aspects of the problem of sensori- 
motor control are specific to the mapping from 
sensory signals to motor outputs and do not 
exist in either domain in isolation. Sensory 
feedback control of hand movements, coordi- 
nate transformations of spatial representations 
and the influence of processing speed and atten- 
tion on sensory contributions to motor control 
are just a few of these. In short, to under- 
stand how human (and animal) actors use sen- 
sory information to guide motor behavior, we 
must study sensory and motor systems as an 



integrated whole rather than as decomposable 
modules in a sequence of discrete processing 
steps (Knill et al, 2007). 

Cognitive neuroscience investigations, inclu- 
ding fMRI studies of human co-action, sug- 
gest that cognitive and neural processes sup- 
porting co-action include joint attention, ac- 
tion observation, task sharing, and action co- 
ordination (Fogassi et al, 2005; Knoblich and 
Jordan, 2003; Newman et al, 2007; Sebanz at 
al, 2006). For example, when two actors are 
given a joint control task (e.g., tracking a mov- 
ing target on screen) and potentially conflicting 
controls (e.g., one person in charge of accelera- 
tion, the other - deceleration), their joint per- 
formance depends on how well they can antici- 
pate each other's actions. In particular, better 
coordination is achieved when individuals re- 
ceive real-time feedback about the timing of 
each other's actions (Sebanz at al, 2006). 

A developing field in coordination dynam- 
ics involves the theory of social coordination, 
which attempts to relate the DC to normal hu- 
man development of complex social cues follow- 
ing certain patterns of interaction. This work is 
aimed at understanding how human social in- 
teraction is mediated by meta-stability of neu- 
ral networks. fMRI and EEC are particularly 
useful in mapping thalamocortical response to 
social cues in experimental studies. In partic- 
ular, a new theory called the Phi complex has 
been developed by S. Kelso and collaborators, 
to provide experimental results for the theory 
of social coordination dynamics (see the recent 
nonlinear dynamics paper discussing social co- 
ordination and EEC dynamics of Tognoli et al, 
2007). According to this theory, a pair of phi 
rhythms, likely generated in the mirror neuron 
system, is the hallmark of human social coor- 
dination. Using a dual-EEC recording system. 



the authors monitored the interactions of eight 
pairs of subjects as they moved their fingers 
with and without a view of the other individ- 
ual in the pair. 

Recently developed Life Space Foam (LSF) 
model (Ivancevic and Aidman, 2007) is an inte- 
gration of two modern approaches to cognition: 
(i) dynamical field theory (DFT, Amari, 1977; 
Schoner, 2007) and (ii) quantum-probabilistic 
dynamics (QP, Glimcher, 2005; Busemayer et 
al, 2006). In this paper we expand the LSF- 
concept to model decision making process in 
human-robot joint action and related LSF-phase 
transitions. 

2 Classical versus Quantum 
Probability 

As quantum probability in human cognition and 
decision making has recently become popular, 
let us briefly describe this fundamental concept 
(for more details, see Ivancevic, 2007a, 2007c, 
2008b). 

2.1 Classical Probability and 
Stochastic Dynamics 

Recall that a random variable X is defined by 
its distribution function f{x). Its probabilistic 
description is based on the following rules: (i) 
P{X = Xi) is the probability that X = xf, 
and (ii) P{a < X < b) is the probability that 
X lies in a closed interval [a,b]. Its statistical 
description is based on: (i) fix or E(X) is the 
mean or expectation of X; and (ii) ax is the 
standard deviation of X. There are two cases 
of random variables: discrete and continuous, 
each having its own probability (and statistics) 
theory. 



A discrete random variable X has only a To emphasize this similarity even further, 

countable number of values {xj}. Its distribu- as well as to set-up the stage for the path inte- 
tion function /(xj) has the following properties: gral, recall the notion of a cumulative distribu- 
tion function of a random variable X, that is a 
P{X = Xi) = f{xi), f{xi) > 0, function F : M -^ M, defined by 






f{xi)dx = 1. 



Statistical description of X is based on its 
discrete mean value ^x ^^^d standard deviation 
axi given respectively by 

^xx = E{X) = ^Xif{xi), 



crx 



E{X^)-^l. 



Here f{x) is a piecewise continuous function 
such that: 



P{a<X<b)= / f{x) dx, fix) > 0, 

J a 

f{x)dx= / f{x)dx = l. 



Statistical description of X is based on its 
continuous mean ^x ^i^d standard deviation 
ax, given respectively by 



/oo 
xfi 
-oo 



x) dx, 



ax = ^E{X^)-l,\. 

Now, let us observe the similarity between 
the two descriptions. The same kind of similar- 
ity between discrete and continuous quantum 
spectrum stroke P. Dirac when he suggested the 
combined integral approach, that he denoted 

by ? - meaning 'both integral and sum at 
once': summing over a discrete spectrum and 
integration over a continuous spectrum. 



F{a) = P{X) < a. 

In particular, suppose that /(x) is the distri- 
bution function of X. Then 



F{x) 
F{x) 



E/(^ 



or 



fOO 



fit) dt, 



according to as x is a discrete or continuous 
random variable. In either case, F{a) < F{b) 
whenever a <b. Also, 



lim F{x) = and 



lim F{x) = 1, 



that is, F{x) is monotonic and its limit to the 
left is and the limit to the right is 1. Further- 
more, its cumulative probability is given by 

P{a<X<b) = F{b) - F{a), 

and the Fundamental Theorem of Calculus tells 
us that, in the continuum case, 

fix) = d^F{x). 

Now, recall that Markov stochastic process 
is a random process characterized by a lack of 
memory, i.e., the statistical properties of the 
immediate future are uniquely determined by 
the present, regardless of the past (Gardiner, 
1985; Ivancevic, 2006b). 

For example, a random walk is an exam- 
ple of the Markov chain, i.e., a discrete-time 
Markov process, such that the motion of the 



system in consideration is viewed as a sequence 
of states, in which the transition from one state 
to another depends only on the preceding one, 
or the probabihty of the system being in state 
k depends only on the previous state k — 1. 
The property of a Markov chain of prime im- 
portance in biomechanics is the existence of an 
invariant distribution of states: we start with 
an initial state xq whose absolute probability is 
1. Ultimately the states should be distributed 
according to a specified distribution. 

Between the pure deterministic dynamics, 
in which all DOF of the system in considera- 
tion are explicitly taken into account, leading 
to classical dynamical equations, for example 
in Hamiltonian form (using dx = d/dx), 



equation reads (Gardiner, 1985): 
R{t) - f3v, 



mv 



where m denotes the mass of the particle and 
V its velocity. The right-hand side represent 
the coupling to a heat hath] the effect of the 
random force R{t) is to heat the particle. To 
balance overheating (on the average), the par- 
ticle is subjected to friction (3. In humanoid 
dynamics this is performed with the Rayleigh- 
Van der Pol's dissipation. Formally, the solu- 
tion to the Langevin equation can be written 
as 



v{t) = v{0) exp 



-It 

m 



dp.H, 



Pi 



-dqiH, 



il) 



+ 



m 



exp[-(t - T)(3/m] R{t) dr, 



(where g% Pi are coordinates and momenta, while ^j^ere the integral on the right-hand side is 
H = Hiq,p) is the total system energy) - and ^ stochastic integral and the solution v{t) is a 
pure stochastic dynamics (Markov process), there^^ndom variable. The stochastic properties of 



is so-called hybrid dynamics, particularly Brow- 
nian dynamics, in which some of DOF are rep- 
resented only through their stochastic influence 
on others. As an example, suppose a system 
of particles interacts with a viscous medium. 
Instead of specifying a detailed interaction of 
each particle with the particles of the viscous 
medium, we represent the medium as a stochas- 
tic force acting on the particle. The stochastic 
force reduces the dimensionally of the dynam- 
ics. 

Recall that the Brownian dynamics repre- 
sents the phase-space trajectories of a collec- 
tion of particles that individually obey Langevin 
rate equations in the field of force (i.e., the par- 
ticles interact with each other via some deter- 
ministic force). For a free particle, the Langevin 



the solution depend significantly on the stochas- 
tic properties of the random force R{t). In the 
Brownian dynamics the random force R{t) is 
Gaussian distributed. Then the problem boils 
down to finding the solution to the Langevin 
stochastic differential equation with the supple- 
mentary condition (zero and mean variance) 

< R{t) > = 0, < R{t) R{0) > = 2(3kBT5{t), 

where < . > denotes the mean value, T is tem- 
perature, ks — equipartition (i.e., uniform dis- 
tribution of energy) coefficient, Dirac (5(t)— func- 
tion. 

Algorithm for computer simulation of the 
Brownian dynamics (for a single particle) can 
be written as (Heermann, 1990): 

1. Assign an initial position and velocity. 



2. Draw a random number from a Gaussian 
distribution with mean zero and variance. 

3. Integrate the velocity to get u""*"^. 

4. Add the random component to the veloc- 
ity. 

Another approach to taking account the cou- 
pling of the system to a heat bath is to subject 
the particles to collisions with virtual particles 
(Heermann, 1990). Such collisions are imag- 
ined to affect only momenta of the particles, 
hence they affect the kinetic energy and in- 
troduce fluctuations in the total energy. Each 
stochastic collision is assumed to be an instan- 
taneous event affecting only one particle. 

The collision-coupling idea is incorporated 
into the Hamiltonian model of dynamics ([1]) by 
adding a stochastic force Ri = Ri{t) to the p 
equation 



or corresponding Ito stochastic integral equa- 
tion 

x\t) = x\Q)+ I dsAi[x\s),s] 



dp.H, 



Pi = -d„^H + Ri{t). 



On the other hand, the so-called Ito stochas- 
tic integral represents a kind of classical Riemann- 
Stieltjes integral from linear functional analy- 
sis, which is (in ID case) for an arbitrary time- 
function G{t) defined as the mean square limit 



+ / dW\s)Bi,[x\s),s], 
Jo 

in which x^{t) is the variable of interest, the 
vector ^j[x(t), f] denotes deterministic drift, the 
matrix Bij[x{t),t] represents continuous stochas- 
tic diffusion fluctuations, and W^{t) is an A^— 
variable Wiener process (i.e., generalized Brow- 
nian motion, see Wiener, 1961) and 

dW^{t) = W\t + dt) - W^{t). 

Now, there are three well-known special cases 
of the Chapman-Kolmogorov equation (see Gar- 
diner, 1985): 

1. When both Bij[x{t),t\ and W{t) are zero, 
i.e., in the case of pure deterministic mo- 
tion, it reduces to the Liouville equation 

dtP{x',t'\x",t") = 
d 



j;--{A,[x(t),t]P(x',t'|x",t")}. 



G{t)dW{t) 



to 



ms 



lim {y^G{ti^i[W{ti)-Witi^i]}. 



2. When only W(t) is zero, it reduces to the 
Fokker-Planck equation 



dtP{x ,t!\x ,t: 



d 



Y^ {AMt),t]P{x',t'\x",t")} + 



Now, the general AD Markov process can 
be defined by Ito stochastic differential equa- 
tion (SDE), 

dxi{t) = Ai[x\t),t]dt + Bij[x\t),t]dW^{t), 
x\0) = Xio, (i,j = l,...,A) 



\E 



dx 

92 



2 ^-^ dx^dx^ 



{Bij[x(t),t]P{x',t'\x",t")] 



3. When both Ai[x{t),t] and Bij[x{t),t\ are 
zero, i.e., the state-space consists of inte- 



gers only, it reduces to the Master equa- 
tion of discontinuous jumps 

dtP{x',t'\x",t") = 

dxW{x'\x",t)P{x',t'\x",t") 

dxW{x"\x',t)P{x',t'\x",t"). 

The Markov assumption can now be formu- 
lated in terms of the conditional probabilities 
P{x^,ti): if the times ti increase from right to 
left, the conditional probability is determined 
entirely by the knowledge of the most recent 
condition. Markov process is generated by a set 
of conditional probabilities whose probability- 
density P = P{x' ,t'\x" ,t") evolution obeys the 
general Chapman-Kolmogorov integro-dijjeren- 
tial equation 

i 

including deterministic drift, diffusion fluctua- 
tions and discontinuous jumps (given respec- 
tively in the first, second and third terms on 
the r.h.s.). 

It is this general Chapman-Kolmogorov inte- 
gro-differential equation, with its conditional 
probability density evolution, P = P{x' , t'\x" , t") 
that we are going to model by the Feynman 

path integral % , providing us with the phys- 
ical insight behind the abstract (conditional) 
probability densities. 



2.2 Quantum Probability Concept 

An alternative concept of probability, the so- 
called quantum probability, is based on the fol- 
lowing physical facts (elaborated in detail in 
this section): 

1. The time-dependent Schrodinger equation 
represents a complex-valued generalization 
of the real-valued Fokker-Planck equa- 
tion for describing the spatio-temporal 
probability density function for the sys- 
tem exhibiting continuous-time Markov 
stochastic process. 

2. The Feynman path integral ? is a gen- 
eralization of the time-dependent Schro- 
dinger equation, including both continuous- 
time and discrete-time Markov stochastic 
processes. 

3. Both Schrodinger equation and path in- 
tegral give 'physical description' of any 
system they are modelling in terms of its 
physical energy, instead of an abstract 
probabilistic description of the Fokker- 
Planck equation. 

Therefore, the Feynman path integral +- , as 
a generalization of the time-dependent Schro- 
dinger equation, gives a unique physical de- 
scription for the general Markov stochastic pro- 
cess, in terms of the physically based general- 
ized probability density functions, valid both 
for continuous-time and discrete-time Markov 
'systems. 

Basic consequence: a different way for cal- 
culating probabilities. The difference is rooted 
in the fact that sum of squares is different from 
the square of sums, as is explained in the fol- 
lowing text. 
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In Dirac-Feynman quantum formalism, each 
possible route from the initial system state A 
to the final system state B is called a history. 
This history comprises any kind of a route (see 
Figure [T]), ranging from continuous and smooth 
deterministic (mechanical-like) paths to com- 
pletely discontinues and random Markov chains 
(see e.g., Gardiner, 1985). Each history (la- 
belled by index k) is quantitatively described 
by a complex number, z^ = r^e '' (with i = 
"v/— 1), called the 'individual transition ampli- 
tude'. Its absolute square, l^fcP, is called the 
individual transition probability. Now, the to- 
tal transition amplitude is the sum of all indi- 
vidual transition amplitudes, '^f^ Zk, called the 
sum~over-histo-ries. The absolute square of 
this sum-over-histories, \'^j^Zk\'^, is the total 
transition probability. 

In this way, the overall probability of the 
system's transition from some initial state A 
to some final state B is given not by adding up 
the probabilities for each history-route, but by 
'head-to-tail' adding up the sequence of am- 
plitudes making-up each route first (i.e., per- 
forming the sum-over-histories) - to get the to- 
tal amplitude as a 'resultant vector', and then 
squaring the total amplitude to get the overall 
transition probability. 

3 The Life Space Foam 

General nonlinear attractor dynamics, both de- 
terministic and stochastic, as well as possibly 
chaotic, developed in the framework of Feyn- 
man path integrals, have recently been applied 
by Ivancevic and Aidman (2007) to formalize 
classical Lewinian field-theoretic psychodynam- 
ics (Lewin, 1951, 1997; Gold, 1999), resulting in 
the development of a new concept of life-space 




Figure 1 : Two ways of physical transition from an 
initial state A to the corresponding final state B. 

(a) Classical physics proposes a single determinis- 
tic trajectory^ minimizing the total system's energy. 

(b) Quantum physics proposes a family of Markov 
stochastic histories, namely all possible routes from 
A to B, both continuous-time and discrete-time 
Markov chains, each giving an equal contribution 
to the total transition probability. 

foam (LSF) as a natural medium for motiva- 
tional and cognitive psychodynamics. Accord- 
ing to the LSF-formalism, the classic Lewinian 
life space can be macroscopically represented as 
a smooth manifold with steady force-fields and 
behavioral paths, while at the microscopic level 
it is more realistically represented as a collec- 
tion of wildly fluctuating force-fields, (loco)mo- 
tion paths and local geometries (and topologies 
with holes). 

We have used the new LSF concept to de- 
velop modelling framework for motivational dy- 
namics (MD) and induced cognitive dynamics 
(CD). Motivation processes both precede and 
coincide with every goal-directed action. Usu- 
ally these motivation processes include the se- 
quence of the following four feedforward phases 
(Ivancevic and Aidman, 2007): (*) 
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1. Intention Formation J-, including: deci- 
sion making, commitment building, etc. 

2. Action Initiation I, including: handling 
conflict of motives, resistance to alterna- 
tives, etc. 

3. Maintaining the Action Ai, including: re- 
sistance to fatigue, distractions, etc. 

4. Termination T, including parking and 
avoiding addiction, i.e., staying in con- 
trol. 

With each of the phases {J^, T, A^ , T} in (*) , we 
can associate a transition propagator - an en- 
semble of (possibly crossing) feedforward paths 
propagating through the 'wood of obstacles' 
(including topological holes in the LSF, see Fig- 
ure [3]), so that the complete transition is a 
product of propagators (as well as sum over 
paths). All the phases-propagators are con- 
trolled by a unique Monitor feedback process. 
A set of least-action principles is used to 
model the smoothness of global, macro-level 
LSF paths, fields and geometry, according to 
the following prescription. The action S[^], 
psycho-physical dimensions of 

Energy x Time = Effort 

and depending on macroscopic paths, fields 
and geometries (commonly denoted by an ab- 
stract field symbol $*) is defined as a temporal 
integral from the initial time instant tj„j to the 
final time instant t/m; 



sm 



fin 



£[$] dt, 



(2) 



with Lagrangian density given by 



£[$] 



where the integral is taken over all n coordi- 
nates x^ = x^{t) of the LSF, and d^j^^ are time 
and space partial derivatives of the $*— variables 
over coordinates. The standard least action 
principle 

5Sm = 0, (3) 

gives, in the form of the so-called Euler-Lagran- 
gian equations, a shortest (loco)motion path, 
an extreme force-field, and a life-space geom- 
etry of minimal curvature (and without holes). 
In this way, we effectively derive a unique glob- 
ally smooth transition map 



F : INTENTIONt. 



ACTIONi 



f f- 1 

(4) 
performed at a macroscopic (global) time-level 
from some initial time tini to the final time 
tjin- In this way, we have obtained macro- 
objects in the global LSF: a single path de- 
scribed by Newtonian-like equation of motion, 
a single force-field described by Maxwellian- 
like field equations, and a single obstacle-free 
Riemannian geometry (with global topology 
without holes). 

To model the corresponding local, micro- 
level LSF structures of rapidly fluctuating cog- 
nitive dynamics, an adaptive path integral is 
formulated, defining a multi-phase and multi- 
path (multi-field and multi-geometry) transi- 
tion amplitude from the state of Intention to 
the state of Action, 



{Action\ Intention) total '■- 



_^P[it;$]e'^[*l, 



rxCi<l>i,d,,^'), 



(5) 

where the Lebesgue integration is performed 
over all continuous <I>*o„ = paths + fields + 
geometries, while summation is performed over 
all discrete processes and regional topologies 
^dis' "^^^ symbolic differential P[i(;$] in the 
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general path integral ([5]), represents an adap- 
tive path measure, defined as a weighted prod- 
uct (with i = 1, ..., n = con + dis) 



Vlw^] = lim 

N — >oo 



N 
s=l 



On the macro-level in LSF we have the 
(loco) rnotzon action principle 

5S[x] = 0, 



(6) with the Newtonian-like action S[x] given by 



The adaptive path integral ([S])-® represents 
an oo— dimensional neural network, with weights 
w updating by the general rule (Ivancevic and 
Aidman, 2007): 

new value{t+l) = old value{t) + innovation{t) . 

The adaptive path integral ([5]) incorporates 
the local Bernstein adaptation process (Bern- 
stein, 1967, 1982): 

desired state SW{t + 1) = 
current state IW{t) + adjustment step /S.W{t) 

as well as the augmented finite state machine 
of Brooks' subsumption architecture (Brooks, 
1986, 1989, 1990), with a networked behavior 
function: 

final state w{t + 1) = 
current state w{t) + 
adjustment behavior f(Aw{t)). 

We remark here that the traditional neural 
networks approaches are known for their classes 
of functions they can represent. This limitation 
has been attributed to their low-dimensionality 
(the largest neural networks are limited to the 
order of 10^ dimensions, see Izhikevich and Edel- 
man, 2008). The proposed path integral ap- 
proach represents a new family of function-re- 
presentation methods, which potentially offers 
a basis for a fundamentally more expansive so- 
lution. 



S[x] 



fi" 1 . . . . 

dt[-g.,x'x^ + ^\x% (7) 



where i* represents motivational (loco) motion 
velocity vector with cognitive processing speed. 
The first bracket term in ([Tj) represents the ki- 
netic energy T, 



1 



9ij -^ -^ ) 



generated by the Riemannian metric tensor gij, 
while the second bracket term, (/9*(x*), denotes 
the family of potential force-fields, driving the 
(loco) motions x* = x*(t) (the strengths of the 
fields (^*(x*) depend on their positions x* in 
LSF. The corresponding Euler-Lagrangian equa- 
tion gives the Newtonian-like equation of mo- 
tion 

(subscripts denote the partial derivatives) , which 
can be put into the standard Lagrangian form 



-(^: 



x»' 



(8) 



dt^^' 



^xh 



with 



L = T 



if {X 



Now, according to Lewin, the life space also 
has a sophisticated topological structure. As 
a Riemannian smooth n— manifold, the LSF- 
manifold 5] gives rise to its fundamental n— 
groupoid, or ri— category n„(S) (see Ivancevic, 
2006b, 2007a). In n„(S), O-cehs are points in 
5]; 1-cells are paths in S (i.e., parameterized 
smooth maps / : [0, 1] ^ S); 2-cells are smooth 
homotopies (denoted by ~) of paths relative 
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to endpoints (i.e., parameterized smooth maps 
h : [0, 1] X [0, 1] ^ S); 3-cells are smooth homo- 
topies of homotopies of paths in S (i.e., param- 
eterized smooth maps j : [0, 1] x [0, 1] x [0, 1] -^ 
S). Categorical composition is defined by past- 
ing paths and homotopies. In this way, the fol- 
lowing recursive homotopy dynamics emerges 
on the LSF-manifold S (**): 
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— cell : xo ' 



/ 



xq £ M; in the higher cells below: t,s £ [0, 1]; 
• xi / : Xq — a;i G M, 



1 — cell : Xq • 

/ : [0, 1] ^ M, / : xo ^ xi, xi = /(xq), /(O) = xq, /(I) = xi; 
e.g., linear path: /(t) = (1 — t) xq + txi; or 

Euler-Lagrangian / — dynamics with endpoint conditions (xo,xi) : 

^/i» = /xM with x(0)=xo, x(l)=xi, (i=l,...,n); 



/ 



2 — cell : Xo ' 



h "Xi h : f ^ g £ M, 
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h : [0, 1] X [0, 1] ^ M, /i : / ^ 5, <7 = /i(/(xo)), 
/i(xo, 0) = /(xo), /i(xo, 1) = ^(a^o), ^(0, t) = xo, /i(l, t) = xi 
e.g., linear homotopy: h{xo,t) = (1 — t) /(xo) +t5f(xo); or 

homotopy between two Euler-Lagrangian (/, g) — dynamics 
with the same endpoint conditions (xo,xi) : 

g^i with x(0) = Xo, x(l)=xi; 
/ 



'17 J i' ~ Jx^^ ^11 cl ~Tl9x^ 



3 — cell : Xq I 




iXi 



j : h^i £ M, 



j : [0, 1] X [0, 1] x[0,l]^M,j:h^i,i = i(/i(/(xo))) 
i(xo, t, 0) = /i(/(xo)), j{xo,t, 1) = i(/(xo)), 
i(xo, 0, s) = /(xq), j{xo, 1, s) = g{xo), 

j{0,t,s) = Xq, i(l,t,s) =Xi 

e.g., linear composite homotopy: j{xo,t,s) = (1 — t) /i(/(xo)) + ti(/(xo)); 
or, homotopy between two homotopies between above two Euler- 
Lagrangian {f,g) — dynamics with the same endpoint conditions (xo,xi). 
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On the micro-LSF level, instead of a single 
path defined by the Newtonian-like equation 
of motion ([8]) , we have an ensemble of fluctuat- 
ing and crossing paths with weighted probabil- 
ities (of the unit total sum). This ensemble of 
micro-paths is defined by the simplest instance 
of our adaptive path integral ([5]) , similar to the 
Feynman's original sum over histories, 



{Action\Intention) paths = fVltux] 



iSW 



(9) 



information flow during the transition Intention 
— > Action. In the connectionist language, ([9]) 
represents activation dynamics, to which our 
Monitor process gives a kind of backpropaga- 
tion feedback, a common type of supervised 
learning^ 

Wsit+l) = Ws{t)-7]VJ{t), (12) 

where rj is a small constant, called the step size, 
or the learning rate, and ^ J{n) denotes the 
gradient of the 'performance hyper-surface' at 
the t-th iteration. 

Now, the basic question about our local de- 
cision making process, occurring under uncer- 
tainty at the intention formation faze J-, is: 
Which alternative to choose? In our path- 
integral language this reads: Which path (al- 
ternative) should be given the highest proba- 
bility weight w'l This problem can be either 
iteratively solved by the learning process ()12|) . 
controlled by the MONITOR feedback, which 
we term algorithmic approach, or by the lo- 
cal decision making process under uncertainty, 
which we term heuristic approach (Ivancevic 
and Aidman, 2007). This qualitative analy- 
sis is based on the micro-level interpretation 
where E^ is the motion energy eigenvalue (re- of the Newtonian-like action S[x\, given by © 
fleeting each possible motivational energetic siaie\^^ figuring both processing speed i and LTM 



where P[ri;x] is a functional measure on the 
space of all weighted paths, and the exponential 
depends on the action S[x\ given by ([7]). This 
procedure can be redefined in a mathematically 
cleaner way if we Wick-rotate the time variable 
t to imaginary values, 1 1— > r = it, thereby mak- 
ing all integrals real: 



fv[ 



T>\wx\ e 



S[x\ 



Wick 



fv[ 



V\wx\ e 



'S[x\ 



(10) 



Discretization of (jlOp gives the standard thermo- 
dynamic-like partition function 



Z 



E' 



-WjE^/T 



(11) 



T is the temperature-like environmental con- 
trol parameter, and the sum runs over all mo- 
tion energy eigenstates (labelled by the index 
j). From (jlip . we can further calculate all 
thermodynamic-like and statistical properties 
of MD and CD, as for example, transition en- 
tropy, S = ks In Z, etc. 



(i.e., the force-field (p{x), see next subsection). 
Here we consider three different cases: 

1. If the potential c/3(x) is not very depen- 
dent upon position x{t), then the more di- 
rect paths contribute the most, as longer 



^Note that we could also use a reward-based, rein- 
forcement learning rule (Suttton and Barto, 1998), in 
3.1 Noisy Decision Making in the LSF ^'^ich system learns its optimal policy: 

T-L. ntT\ J-- J i- ii, ■ J. innovation(t) = Irewardit) — penalty (t)\. 

brom CD-perspective, our adaptive path mte- ^ ' ' \ j f y\ j\ 

gral ([9]) calculates all (alternative) pathways of 
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paths, with higher mean square velocities 
[i:(t)]^ make the exponent more negative 
(after Wick rotation (fTOll ). 

2. On the other hand, suppose that (/?(x) 
does indeed depend on position x. For 
simpUcity, let the potential increase for 
the larger values of x. Then a direct path 
does not necessarily give the largest con- 
tribution to the overall transition prob- 
ability, because the integrated value of 
the potential is higher than over another 
paths. 

3. Finally, consider a path that deviates wide- 
ly from the direct path. Then (p{x) de- 
creases over that path, but at the same 
time the velocity x increases. In this case, 
we expect that the increased velocity x 
would more than compensate for the de- 
creased potential over the path. 

Therefore, the most important path (i.e., the 
path with the highest weight w) would be the 
one for which any smaller integrated value of 
the surrounding field potential (p{x) is more 
than compensated for by an increase in kinetic- 
like energy y^'^- I^ principle, this is neither 
the most direct path, nor the longest path, but 
rather a middle way between the two. For- 
mally, it is the path along which the average 
Lagrangian is minimal. 



m 



< '-^x^ + ^{x) > 



mm, 



(13) 



i.e., the path that requires minimal memory (both 
LTM and WM) and processing speed. This me- 
chanical result is consistent with the 'cognitive 
filter theory' of selective attention (Broadbent, 
1958), which postulates a low level filter that 
allows only a limited number of percepts to 



reach the brain at any time. In this theory, 
the importance of conscious, directed attention 
is minimized. The type of attention involving 
low level filtering corresponds to the concept of 
early selection. 

Although we termed this 'heuristic approach' 
in the sense that we can instantly feel both the 
processing speed x and the LTM field <^(x) in- 
volved, there is clearly a psycho-physical rule 
in the background, namely the averaging min- 
imum relation (|13p . 

From the decision making point of view, all 
possible paths (alternatives) represent the con- 
sequences of decision making. They are, by 
default, short-term consequences, as they are 
modelled in the micro-time-level. However, 
the path integral formalism allows calculation 
of the long-term consequences, just by extend- 
ing the integration time, tjj„ — > oo. Besides, 
this averaging decision mechanics - choosing 
the optimal path - actually performs the 'aver- 
aging lift' in the LSF: from the micro-level to 
the macro-level. 

For example, one of the simplest types of 
performance-degrading disturbances in the LSF 
is what we term motivational fatigue - a moti- 
vational drag factor that slows the actors' prog- 
ress towards their goal. There are two funda- 
mentally different sources of this motivational 
drag, both leading to apparently the same re- 
duction in performance: (a) tiredness / exhaus- 
tion and (b) satiation (e.g., boredom). Both in- 
volve the same underlying mechanism (the rais- 
ing valence of the alternatives to continuing the 
action) but the alternatives will differ consider- 
ably, depending on the properties of the task, 
from self-preservation / recuperation in the ex- 
haustion case through to competing goals in the 
satiation case. 

The spatial representation of this motiva- 
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tional drag is relatively simple: uni-dimensional 
LSF-coordinates may be sufficient for most pur- 
poses, which makes it attractive for the initial 
validation of our predictive model. Similarly 
uncomplicated spatial representations can be 
achieved for what we term motivational boost 
derived from the proximity to the goal (includ- 
ing the well-known phenomenon of 'the home 
stretch'): the closer the goal (e.g., a finishing 
line) is perceived to be, the stronger its 'pulling 
power' (Lewin 1951, 1997). Combinations of 
motivational drag and motivational boost ef- 
fects may be of particular interest in a range of 
applications. These combinations can be mod- 
elled within relatively simple uni-dimensional 
LSF-coordinate systems. 

4 Geometric Chaos and Topo- 
logical Phase Transitions 

In this section we extend the LSF-formalism to 
incorporate geometrical chaos (Ivancevic et al, 
2008; Ivancevic, 2006c, 2008a) and associated 
topological phase transitions. 

It is well-known that on the basis of the er- 
godic hypothesis, statistical mechanics describes 
the physics of many-degrees of freedom sys- 
tems by replacing time averages of the relevant 
observables with ensemble averages. Therefore, 
instead of using statistical ensembles, we can 
investigate the Hamiltonian (microscopic) dy- 
namics of a system undergoing a phase tran- 
sition. The reason for tackling dynamics is 
twofold. First, there are observables, like Lya- 
punov exponents, that are intrinsically dynam- 
ical. Second, the geometrization of Hamilto- 
nian dynamics in terms of Riemannian geom- 
etry provides new observables and, in general, 
an interesting framework to investigate the phe- 



nomenon of phase transitions (Caiani et al, 1997; 
Pettini, 2007). The geometrical formulation 
of the dynamics of conservative systems (see 
Ivancevic, 2006b, 2008a) was ffist used by Krylov 
(1979) in his studies on the dynamical founda- 
tions of statistical mechanics and subsequently 
became a standard tool to study abstract sys- 
tems in ergodic theory. 

The simplest, mechanical-like LSF-action 
in the individual's LSF-manifold Xl has a Rie- 
mannian locomotion form (summation conven- 
tion is always assumed) 



S[q] 



1 /■*/ 



[aij ctq^ - V{q)] dt, (14) 



where aij is the 'material' metric tensor that 
generates the total 'kinetic energy' of cognitive 
(loco) motions defined by their configuration co- 
ordinates g* and velocities q^, with the motiva- 
tional potential energy V{q) and the standard 
Hamiltonian 



Hip,q) 



^ 1 



Pl + Viq), 



(15) 



where pi are the canonical (loco) motion mo- 
menta. 

Dynamics of N DOF mechanical-like sys- 
tems with action (J14p and Hamiltonian (J15p are 
commonly given by the set of geodesic equations 
(Ivancevic, 2006b, 2007a) 



d\ 



ds"^ 



, dq^dc^ 
^ ^^ ds ds 



0, 



(16) 



where F*^ are the Christoffel symbols of the 
affine Levi-Civita connection of the Rieman- 
nian LSF-manifold 5]. 

Alternatively, a description of the extrema 
of the Hamilton's action (1141) can be obtained 
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using the Eisenhart metric (see Eisenhart, 1929) 
on an enlarged LSF space-time manifold (given 
by {g" = t,q^,..., q^} plus one real coordinate 
qN+i^^ whose arc-length is 



Oj^Af+l 



ds^ = -2V{q){dq^Y + aijdq'dq^ + 2dq''dq 

(17) 
The manifold has a Lorentzian structure (Pet- 
tini, 2007) and the dynamical trajectories are 
those geode-sics satisfying the condition ds'^ = 
Cdt^, where C is a positive constant. In this 
geometrical framework, the instability of the 
trajectories is the instability of the geodesies, 
and it is completely determined by the curva- 
ture properties of the LSF-manifold XI accord- 
ing to the Jacobi equation of geodesic deviation 
(see Ivancevic, 2006b, 2007a) 



ds^ ^■'^'"ds ds 



0, 



(18) 



whose solution J, usually called Jacobi vari- 
ation field, locally measures the distance be- 
tween nearby geodesies; D/ds stands for the 
covariant derivative along a geodesic and R^ jj^^ 
are the components of the Riemann curvature 
tensor of the LSF-manifold S. 

Using the Eisenhart metric (J17p . the rele- 
vant part of the Jacobi equation (fTSl) is given 
by the tangent dynamics equation (Casetti et 
al, 1996; Caiani et al, 1997) 






+ R OfcO'^ 



0, 



(f = l,...,iV), (19) 



where the only non-vanishing components of 
the curvature tensor of the LSF-manifold S 



are 



K 



OfcO 



d^V/dq'dqK 



The tangent dynamics equation (J19p is com- 
monly used to define Lyapunov exponents in 



dynamical systems given by the Riemannian 
action (114^ and Hamiltonian (llSp , using the for- 
mula (Casetti et al, 2000) 



Al 



lim l/2tlog(Sili[J/(t) 



t^oo 



(20) 



+ J/(t)]/SiIi[J/(0) + J/(0)]). 



Lyapunov exponents measure the strength of 
dynamical chaos. 

Now, to relate these results to topological 
phase transitions within the LSF-manifold XI, 
recall that any two high-dimensional manifolds 
S^ and S„' have the same topology if they can 
be continuously and differentiably deformed into 
one another, that is if they are diffeomorphic. 
Thus by topology change the 'loss of diffeomor- 
phicity' is meant (Pettini, 2007). In this re- 
spect, the so-called topological theorem (Fran- 
zosi and Pettinni, 2004) says that non-analyti- 
city is the 'shadow' of a more fundamental phe- 
nomenon occurring in the system's configura- 
tion manifold (in our case the LSF-manifold): 
a topology change within the family of equipo- 
tential hypersurfaces 

^, = {{q\...,q^)eR^\V{q\...,q'')=v}, 

where V and g* are the microscopic interaction 
potential and coordinates respectively. This 
topological approach to PTs stems from the nu- 
merical study of the dynamical counterpart of 
phase transitions, and precisely from the obser- 
vation of discontinuous or cuspy patterns dis- 
played by the largest Lyapunov exponent Ai at 
the transition energy (Casetti et al, 2000). Lya- 
punov exponents cannot be measured in labo- 
ratory experiments, at variance with thermo- 
dynamic observables, thus, being genuine dy- 
namical observables they are only be estimated 
in numerical simulations of the microscopic dy- 



17 



namics. If there are critical points of V in con- 
figuration space, that is points Qc = [^i, • • • ,^jv] 



such that W{q)\ 



q=qc 



0, according to the 



Morse Lemma (see e.g., Hirsch, 1976), in the 
neighborhood of any critical point Qc there al- 
ways exists a coordinate system 
q{t) = [q^{t),..,q^{t)] for which 



V{q) = V{q, 



fl 



ql + ql+l + 



(21) 
where k is the index of the critical point, i.e., 
the number of negative eigenvalues of the Hes- 
sian of the potential energy V . In the neigh- 
borhood of a critical point of the LSF-manifold 
S, dnD yields 

d'^V/dq'dq^ = ±5ij, 

which gives k unstable directions which con- 
tribute to the exponential growth of the norm 
of the tangent vector J (Casetti et all, 2000). 

This means that the strength of dynami- 
cal chaos within the individual's LSF-manifold 
S, measured by the largest Lyapunov exponent 
Ai given by (i20]) . is affected by the existence of 
critical points qc of the potential energy V{q). 
However, asV{q)\s bounded below, it is a good 
Morse function, with no vanishing eigenvalues 
of its Hessian matrix. According to Morse the- 
ory, the existence of critical points of V is asso- 
ciated with topology changes of the hypersur- 
faces {Stjj^gR. 

More precisely, let Viqiqi, ■ ■ ■ ,qN) '■ R^ — *■ 
R, be a smooth, bounded from below, finite- 
range and confining potentiao Denote by Sj, = 
V^^{v), V ^ R, its level sets, or equipotential 
hyper surf aces, in the LSF-manifold S. Then 



^ These requirements for V are fulfilled by standard 
interatomic and intermolecular interaction potentials, 
as well as by classical spin potentials. 



let V = v/N be the potential energy per degree 
of freedom. If there exists A'o, and if for any 
pair of values v and v' belonging to a given in- 
terval Ijj = [vq,vi\ and for any N > Nq then 
the sequence of the Helmoltz free energies 
{F/v(/3)}7VeN ~ where (3 = 1/T (T is the tem- 
perature) and (3 G I^ = {l3{vo), P{vi)) - is 
uniformly convergent at least in C'^{Ip) [the 
space of twice differentiable functions in the in- 
terval Ip], so that lim.]\f^ooF]\j G C'^{Ip) and 
neither first nor second order phase transitions 
can occur in the (inverse) temperature interval 
{l3{vQ),f5{vi)), where the inverse temperature is 
defined as (Pettini, 2007) 



(3{v) = dS^-\v)/dv, 



while 



V{q)<vN 

is one of the possible definitions of the micro- 
canonical configurational entropy. The inten- 
sive variable v has been introduced to ease the 
comparison between quantities computed at dif- 
ferent A'^- values. 

This theorem means that a topology change 
of the {S^j^gK at some Vc is a necessary con- 
dition for a phase transition to take place at 
the corresponding energy value. The topol- 
ogy changes implied here are those described 
within the framework of Morse theory through 
'attachment of handles' to the LSF-manifold S 
(Hirsch, 1976). 

In the LSF path-integral language, we can 
say that suitable topology changes of equipo- 
tential submanifolds of the individual's LSF- 
manifold XI can entail thermodynamic-like phase 
transitions, according to the general formula: 



(phase out | phase in) := 



Jti 



topology— change 



V[w^ e 



i5f*l 
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The statistical behavior of the LSF-(loco)inoti- 
on system ()14p with the standard Hamiltonian 
(jlSp is encompassed, in the canonical ensemble, 
by its partition function, given by the phase- 
space path integral (Ivancevic, 2007a, 2008a) 

(22) 
where we have used the shorthand notation 

dq{T)dp{T) 



integrals, 



J 2-11) 



da I WW \ 



lp-ch^bp['^]-/n- 



27r 



The phase-space path integral (p2|) can be cal- 
culated as the partition function (Franzosi et 
al, 2000) 



N 
Zn{(3)= Hdpidq'e 



-l3H{v,q) 



M. , N 



a 



Wdq'e-^^'^'i^ 



i=l 



■k\ 2 



/? 



dve 



-fSv 



da 



Zj-tj 



VV 



.(23) 



where the last term is written using the so- 
called co-area formula (Federer, 1969), and v 
labels the equipotential hypersurfaces S^ of the 
LSF-manifold 51, 

i:, = {iq\...,q^)GR^\V{q\...,q'')=v}. 

Equation (|23p shows that the relevant statis- 
tical information is contained in the canonical 
configurational partition function 



Z^= lU'^q'Viqy 



■/3V{q) 



Note that Z^ is decomposed, in the last term 
of (|23p , into an infinite summation of geometric 



defined on the {Il„}^,gK. Once the microscopic 
interaction potential V{q) is given, the configu- 
,ration space of the system is automatically fo- 
liated into the family {S„}„gR of these equipo- 
tential hypersurfaces. Now, from standard sta- 
tistical mechanical arguments we know that, at 
any given value of the inverse temperature /3, 
the larger the number A^, the closer to S^ = 
Tjua are the microstates that significantly con- 
tribute to the averages, computed through Z]\f{f3), 
of thermodynamic observables. The hypersur- 
face T,u„ is the one associated with 



Up 



(Z^)-' lldq^Viq)e- 



-PV(q) 



the average potential energy computed at a given 
(3. Thus, at any (3,\iN\s very large the effec- 
tive support of the canonical measure shrinks 
very close to a single S^ = S„^. Hence, the 
basic origin of a phase transition lies in a suit- 
able topology change of the {S^}, occurring 
at some Vc (Franzosi et al, 2000). This topol- 
ogy change induces the singular behavior of the 
thermodynamic observables at a phase transi- 
tion. It is conjectured that the counterpart of a 
phase transition is a breaking of diffeomorphic- 
ity among the surfaces S^, it is appropriate to 
choose a diffeomorphism invariant to probe if 
and how the topology of the S^, changes as a 
function of v. Fortunately, such a topological 
invariant exists, the Euler characteristic of the 
LSF-manifold 5], defined by (Ivancevic, 2007a) 



N 



x(s) = 5^(-i)%(s), 



(24) 



fe=o 
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where the Betti numbers bk{T,) are diffeomor- as a macroscopic system which is a quantum 
phism invariantslfl This homological formula system not in the trivial sense that it is made, 
can be simplified by the use of the Gauss-Bonnet-like all existing matter, by quantum compo- 



Hopf theorem, that relates x(^) with the total 
Gauss-Kronecker curvature Kq of the LSF- 
manifold XI 



X(S) 



Kg da, 



(25) 



where 



da = y^det{a)dx^dx'^ ■ ■ ■ dx^ 

is the invariant volume measure of the LSF- 
manifold S and a is the determinant of the 
LSF metric tensor Uij (Ivancevic, 2008a). 



The domain of validity of the 'quantum' is 
not restricted to the microscopic world (Umezawatems intrinsic behavior. The phase transition 



nents such as atoms and molecules, but in the 
sense that some of its macroscopic properties 
can best be described with recourse to quan- 
tum dynamics (see Freeman and Vitiello, 2006 
and references therein). 

Phase transitions can also be associated with 
autonomous robot competence levels, as infor- 
mal specifications of desired classes of behav- 
iors for robots over all environments they will 
encounter, as described by Brooks' subsump- 
tion architecture approach. The distributed 
network of augmented finite-state machines can 
exist in different phases or modalities of their 
state-space variables, which determine the sys- 



1993). There are macroscopic features of clas- 
sically behaving systems, which cannot be ex- 
plained without recourse to the quantum dy- 
namics. This field theoretic model leads to the 
view of the phase transition as a condensation 
that is comparable to the formation of fog and 
rain drops from water vapor, and that might 
serve to model both the gamma and beta phase 
transitions. According to such a model, the 
production of activity with long-range correla- 
tion in the brain takes place through the mech- 
anism of spontaneous breakdown of symmetry 
(SBS), which has for decades been shown to de- 
scribe long-range correlation in condensed mat- 
ter physics. The adoption of such a field theo- 
retic approach enables modelling of the whole 
cerebral hemisphere and its hierarchy of com- 
ponents down to the atomic level as a fully in- 
tegrated macroscopic quantum system, namely 



^The Betti numbers bk axe the dimensions of the de 
Rham's cohomology vector spaces _H"'^(E;R) (therefore 
the bk are integers). 



represented by this approach is triggered by ei- 
ther internal (a set-point) or external (a com- 
mand) control stimuli, such as a command to 
transition from a sleep mode to awake mode, 
or walking to running. 

5 Joint Action of Several 
Agents 

In this section we propose an LSF-based model 
of the joint action of two or more actors, where 
actors can be both humans and robots. This 
joint action takes place in the joint LSF mani- 
fold Sj, composed of individual LSF manifolds 
IIq,,^^,.... It has a sophisticated geometrical 
and dynamical structure as follows. 

To model the dynamics of the two-actor co- 
action, we propose to associate each of the ac- 
tors with a set of their own time dependent tra- 
jectories, which constitutes an n— dimensional 
Riemannian LSF-manifold, S^ = {a;*(tj)} and 
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11/3 = {^"'(^j)}) respectively. Their associated 
tangent bundles contain their individual nD 
(loco) motion velocities, TT,a = {i'(ij) = dx'^/dti 
and rS^ = {y^{tj) = dy^ /dtj}. Further, fol- 
lowing the general LSF-fornialism, outlined in 
the introduction, we use the modelling machin- 
ery consisting of: (i) Adaptive joint action at 
the top-master level, describing the externally- 
appearing deterministic, continuous and smooth 
dynamics, and (ii) Corresponding adaptive path 
integral (j30p at the bottom-slave level, describ- 
ing a wildly fluctuating dynamics including both 
continuous trajectories and Markov chains. This 
lower-level joint dynamics can be further dis- 
cretized into a partition function of the corre- 
sponding statistical dynamics. 

The smooth joint action with two terms, 
representing cognitive/motivational potential en- 
ergy and physical kinetic energy, is formally 
given by: 

A[x, y; ti, tj\ = 

^ [ [ ail3j5{ll) x\U)y\tj) dUdtj 



agents, vanishes. Note that the cognitive (loco) 
motions of the two agents ai[x^{ti)] and (3 j[y^{tj)], 
jgenerally occur at different times tj and tj un- 
less ti = tj, when cognitive synchronization oc- 
curs. 



The second term in ([26]) represents kinetic 
energy of the physical interaction. Namely, when 
the cognitive synchronization in the first term 
takes place, the second term of physical kinetic 
energy is activated in the common manifold, 
which is one of the agents' Life Spaces, say 

^a = {x'{t,)}. 

Conversely, if we have a need to represent 
coaction of three actors, say Qj, Pj and 7^ (e.g., 
Ui in charge of acceleration, Pj - deceleration 
and 7y!j— steering), we can associate each of 
them with an nD Riemannian Life-Space man- 
ifold, Sq, = {x'iti)}, T,i3 = {y^{tj)}, and S^ = 
{z (tk)}, respectively, with the corresponding 
tangent bundles containing their individual (loco) 
motion velocities, TT,a = {i;*(tj) = dx^/dti}, 
T^p = {yi{tj) = dyi/dtj] and TS^ = {z\tk) 
= dz /dtk}. Then, instead of (j26p we have 



ti Jtj 



1 



+ gtjx\t)x^{t)dt, 



(26) 



^[tj, tj, tj;', t\ 
1 



with 



If^ = \x'(ti)-y^(t,f, 




ai{ti)(3j{tj)-fp,{tk) X 



where IN <ti,tj,t< OUT. 

The first term in (I26p represents potential en- 
ergy of the cognitive/motivational interaction 
between the two agents «» and /9jc| It is a dou- 
ble integral over a delta function of the square 
of interval P between two points on the paths 
in their Life-Spaces; thus, interaction occurs 
only when this interval, representing the mo- 
tivational cognitive distance between the two 



(5(/4) x\ti) y^tj) i^{tk) dtidtjdtk 



+ 



\ [W,'^{t,q,q)q'rdt, (27) 

J t 



where IN < ti,tj,tk, t < OUT, 



It,k=[x\k)-y^{t,)r + [y^tj)-z'it,)] 



r2 ^ l^iUA „..7V+m2 
+ [z'=(tfc)-X^(t,)]2, 



with 

ku m2 



^Although, formally, this term contains cognitive ve- 
locities, it still represents 'potential energy' from the 
physical point of view. 



Due to an intrinsic chaotic coupling, the 
three-actor (or, n— actor, n > 3) joint action 
([27P has a considerably more complicated geo- 
metrical structure then the bilateral co-action 
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()26p rl It actually happens in the common 3nD 
Finsler manifold Sj = Sq U S^ U S^, param- 
eterized by the local joint coordinates depen- 
dent on the common time t. That is, Sj = 
{q^{t), r = l,...,3n}. Geometry of the joint 
manifold Sj is defined by the Finsler metric 
function ds = F{q'^ , dq^), defined by 



F'^{qA) = 9rs{qAW (f , 



(28) 



and the Finsler tensor Crst[q-,q)i defined by 
(Ivancevic, 2007a) 



Crst{q,q) 



ld^F\q,q) 1 dgr 



4 dq'^dq^dq^ 2 d(fdq^ 



(29) 



From the Finsler definitions ([MD-dlS]), it fol- 
lows that the partial interaction manifolds, SqU 
S^, S^ U Tiy and Sq, U S^^, have Riemannian 
structures with the corresponding interaction 
kinetic energies. 



Tap = T,9ijX'y^ 



1 

T 



i -k 



'a7 — rsdik^ Z 



At the slave LSF~level, the adaptive path 
integral, representing an oo— dimensional neu- 
ral network, corresponding to the adaptive bi- 
lateral joint action (p6]) . reads 



{OUT\IN) ■.= fv[w,x,y]e' 



A[x,y;ti,tj] 



(30) 



where the Lebesgue integration is performed 
over all continuous paths x* = x^(ti) and y^ = 
y^{tj), while summation is performed over all 
associated discrete Markov fluctuations and 
jumps. The symbolic differential in the path 



^Recall that the necessary condition for chaos in con- 
tinuous temporal or spatio-temporal systems is to have 
three variables with nonlinear couplings between them. 



integral ([30]) represents an adaptive path mea- 
sure, defined as a weighted product 



N 

V[w,x,y]= lim Ylwf.dx'dy^, (31) 

{i,j = l,...,n). 



Similarly, in case of the triple joint action, 
the adaptive path integral reads. 



{OUT\IN) ■.= fv[w;x,y,z;q]e 



iA[t,,tj,tfe;t] 



(32) 



with the adaptive path measure defined by 

N 

'D[w;x,y,z;q]= lim \\ w^jf^^Ax^dy^dz dq^, 
5=1 
{i,j,k = l,...,n; r = l,...,3n). (33) 

The proposed path integral approach repre- 
sents a new family of more expansive function- 
representation methods, which is now capable 
of representing input/output behavior of more 
than one actor. However, as we add the sec- 
ond and subsequent actors to the model, the 
requirements for the rigorous geometrical rep- 
resentations of their respective LSFs become 
nontrivial. For a single actor or a two-actor 
co-action the Riemannian geometry was suffi- 
cient, but it becomes insufficient for modelling 
the n-actor (with n > 3) joint action, due to 
an intrinsic chaotic coupling between the in- 
dividual actors' LSFs. To model an n-actor 
joint LSF, we have to use the Finsler geome- 
try, which is a generalization of the Riemannian 
one. This progression may seem trivial, both 
from standard psychological point of view, and 
from computational point of view, but it is not 
trivial from the geometrical perspective. 

Our extended LSF formalism is closely re- 
lated to the Haken-Kelso-Bunz (HKB) model 
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of self-organization in the human motor sys- 
tem (Haken et al, 1985; Kelso, 1995), including: 
multi-stability, phase transitions and hystere- 
sis effects, presenting a contrary view to the 
purely feedback driven neural systems. HKB 
uses the concepts of synergetics (order param- 
eters, control parameters, instability, etc) and 
the mathematical tools of nonlinearly coupled 
(nonlinear) dynamical systems to account for 
self-organized behavior both at the coopera- 
tive, coordinative level and at the level of the 
individual coordinating elements. The HKB 
model stands as a building block upon which 
numerous extensions and elaborations have been 
constructed. In particular, it has been possible 
to derive it from a realistic model of the cortical 
sheet in which neural areas undergo a reorga- 
nization that is mediated by intra- and inter- 
cortical connections. Also, the HKB model de- 
scribes phase transitions ('switches') in coordi- 
nated human movement as follows: (i) when 
the agent begins in the anti-phase mode and 
speed of movement is increased, a spontaneous 
switch to symmetrical, in-phase movement oc- 
curs; (ii) this transition happens swiftly at a 
certain critical frequency; (iii) after the switch 
has occurred and the movement rate is now de- 
creased the subject remains in the symmetrical 
mode, i.e. she does not switch back; and (iv) no 
such transitions occur if the subject begins with 
symmetrical, in-phase movements. The HKB 
dynamics of the order parameter relative phase 
as is given by a nonlinear first-order ODE: 

(j) = {a + 2/3r ) sin (/) — /3r sin 20, 

where (p is the phase relation (that character- 
izes the observed patterns of behavior, changes 
abruptly at the transition and is only weakly 
dependent on parameters outside the phase tran- 
sition), r is the oscillator amplitude, while a, f3 



are coupling parameters (from which the criti- 
cal frequency where the phase transition occurs 
can be calculated). 

From a quantum perspective, closely related 
to the LSF model are the recent developments 
of Hong and Neweh (2008a, 2008b) in motor 
control that deal with feedback information and 
environmental uncertainty. The probabilistic 
nature of human action can be characterized 
by entropies at the level of the organism, task, 
and environment. Systematic changes in motor 
adaptation are characterized as task-organism 
and environment -organism tradeoffs in entropy. 
Such compensatory adaptations lead to a view 
of goal-directed motor control as the product 
of an underlying conservation of entropy across 
the task-organism-environment system. The 
conservation of entropy supports the view that 
context dependent adaptations in human goal- 
directed action are guided fundamentally by 
natural law and provides a novel means of ex- 
amining human motor behavior. This is funda- 
mentally related to the Heisenberg uncertainty 
principle and further support the argument for 
the primacy of a probabilistic approach toward 
the study of bio-psychological systems. 
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Figure 2: Diagram of the life space foam: classical representation of Lewinian life space, with 

an adaptive path integral ? (denoting integration over continuous paths and summation over 
discrete Markov jumps) acting inside it and generating microscopic fluctuation dynamics. 
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Figure 3: Transition-propagator corresponding to each of the motivational phases {J-,I,Ai,T}, 
consisting of an ensemble of feedforward paths propagating through the 'wood of obstacles'. 
The paths affected by driving and restraining force-fields, as well as by the local LSF-geometry. 
Transition goes from Intention, occurring at a sample time instant to, to Action, occurring at 
some later time ti. Each propagator is controlled by its own Monitor feedback. 
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motiv-cog potential ensrgy 

■2 



^ = / / «''^j ^Wj) *'(*'■) y'i^i) *'-'^*i 



2 



two timescales 



1 /" physical kinetic energy 
^ Ji one timescale 

with 4. = [a;*(i,) - 2/^{i,.)]' 

motiv-cog distance 

Figure 4: Feynman action for modelling human joint action, including potential energy (motivational 
cognition) in two timescales, physical energy in a single timescale (after synchronization has already 
occurred), and the distance between two agents in the motivational cognition space. 
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6 Conclusion 

General stochastic and quantum dynamics, de- 
veloped in a framework of Feynman path inte- 
grals, have recently been applied by Ivancevic 
and Aidman (2007) to Lewinian field-theoretic 
psycho dynamics, resulting in the development 
of a new concept of Life-Space Foam (LSF) as 
a natural medium for motivational (MD) and 
cognitive (CD) psychodynamics. According to 
the LSF-formalism, the classic Lewinian life 
space can be macroscopically represented as a 
smooth manifold with steady force-fields and 
behavioral paths, while at the microscopic level 
it is more realistically represented as a collec- 
tion of wildly fluctuating force-fields, (loco)mo- 
tion paths and local geometries (and topolo- 
gies with holes). This paper extends the LSF- 
model to incorporate the notion of phase tran- 
sitions and complements it with embedded geo- 
metrical chaos. As a result, the extended LSF- 
model is able to rigorously represent co-action 
by two or more human-like agents in the com- 
mon LSF-manifold. The extended LSF-model 
is also related to the HKB-model of self-organi- 
zation in the human motor system, presenting 
a contrary view to the purely feedback driven 
neural systems, as well as Hong-Newell entropy- 
approach to adaptation in human goal-directed 
motor control. 
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